Skip to content

[pull] main from NVIDIA:main#1491

Merged
pull[bot] merged 9 commits into
LarryXFly:mainfrom
NVIDIA:main
Jul 17, 2026
Merged

[pull] main from NVIDIA:main#1491
pull[bot] merged 9 commits into
LarryXFly:mainfrom
NVIDIA:main

Conversation

@pull

@pull pull Bot commented Jul 17, 2026

Copy link
Copy Markdown

See Commits and Changes for more details.


Created by pull[bot] (v2.0.0-alpha.4)

Can you help keep this open source service alive? 💖 Please sponsor : )

kaiyux and others added 9 commits July 17, 2026 13:12
… PyTorch executor decode path (#16313)

Signed-off-by: Kaiyu Xie <26294424+kaiyux@users.noreply.github.com>
…he reachable ceiling instead of force-appending it (#16256)

Signed-off-by: Dongfeng Yu <dongfengy@nvidia.com>
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
…16398)

Signed-off-by: Yuxian Qiu <142763828+yuxianq@users.noreply.github.com>
…UDA-graph stale-pointer IMA) (#16307)

Signed-off-by: Iman Tabrizian <10105175+tabrizian@users.noreply.github.com>
…-OSS pairing (#16378)

Signed-off-by: tianruih <tianruih@nvidia.com>
…/output lengths (#16538)

Signed-off-by: yufeiwu-nv <230315618+yufeiwu-nv@users.noreply.github.com>
* Why?

While investigating NVBug 6336747, we found a cluster epilog could
remove PyTorch shared-memory files belonging to another same-account
job on the node.

The resulting worker abort exposed a separate API bug: when no terminal
response arrived, we could could still wait on the result indefinitely
because it ignored the timeout.

The cluster cleanup issue is being fixed independently. Honoring the
existing timeout contract gives callers a reliable bound when an
executor stops producing responses.

* What?

Apply timeout as a total budget across all response steps, measured
with a monotonic clock. Pass the remaining budget to both queue
implementations and raise `TimeoutError` when it expires. Preserve
nonblocking `timeout=0 `behavior for responses already queued, and add
focused coverage for these paths.

Signed-off-by: William Zhang <133824995+2ez4bz@users.noreply.github.com>
…in_adp and is_all_greedy_sample`, keep… (#16440)

Signed-off-by: ZhaoyangWang <zhaoyangw@nvidia.com>
Signed-off-by: yiqingy <yiqingy@tensorrt-llm-infra-debug-vm-01.nvidia.com>
Co-authored-by: yiqingy <yiqingy@tensorrt-llm-infra-debug-vm-01.nvidia.com>
@pull pull Bot locked and limited conversation to collaborators Jul 17, 2026
@pull pull Bot added the ⤵️ pull label Jul 17, 2026
@pull
pull Bot merged commit 01f3463 into LarryXFly:main Jul 17, 2026
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

9 participants